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Lessons Learned is 


o knowledge or understanding 
gained by experience. The 
experience may be positive, as 
in a successful test or mission, 
or negative, as in a mishap or 
failure. Both should be 
considered excellent sources of 
lessons learned. 


Problem Introduction 


Throughout NASA's history (Mercury Program, 
Gemini Program, Apollo Program, Skylab 
Program, Space Shuttle Program, International 
Space Station Program, Constellation Program, 
SLS and Orion Programs) many lessons have 
been learned. 

• These lessons deal with very complex and 
unique systems. 

• This knowledge needs to be carried over into 
new programs. 

• The lessons learned may not be needed for 
several years to come. 
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Solution 


• NASA policy requires each Program or Project to 
develop a plan for how they will address Lessons 
Learned. 

• Projects have the flexibility to determine how 
best to promote and implement lessons learned. 

• A large project might budget for a lessons 
learned position to coordinate elicitation, 
documentation and archival of the project 
lessons. 


The LLIS process 


o 

o 


The lessons learned process crosses all NASA 
Centers and includes the contactor community. 

The Office of The Chief Engineer at NASA 
Headquarters in Washington D.C., is the overall 
process owner, and field locations manage the 
local implementation. 
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Solution 


• One tool used to transfer knowledge between program and 
projects is the Lessons Learned Information System (LLIS). 

• Most lessons come from NASA in partnership with support 
contractors. 

• A search for lessons that might impact a new design is 
often performed by a contractor team member. 

• Knowledge is not found with only one person, one project 
team, or one organization. Sometimes, another project 
team, or person, knows something that can help your 
project or your task. 
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The LLIS process - Life Cycle 

The lessons learned life cycle involves sources such as 
engineering design teams, mishap reports, research, science, 
operations, administration, procurement, management, 
safety, maintenance, training, flight or ground-based 
systems, facilities, medicine, etc. 
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The LLIS process - Gathering 


o Key decision points and design milestones are potential 
lessons learned points. 

o The team should try to focus on five questions: 

o What did we intend to do? 
o What worked well and why? 
o What didn't work well and why? 
o What did we learn from this? 
o What should we change? 

o These questions and others are used to extract the root 
causes and contributing factors of the lessons, and then the 
lessons are submitted for expert peer review for possible 
inclusion into LLIS. 
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The LLIS process - Gathering 

A successful knowledge-sharing workshop allows 
all team members to contribute ideas, and 
discipline leads often "distill" the input down to a 
few major points for action. 




I lie- date* tins lesson 
occurred 

A person who would 
know about tins lesson 

Includes part of*: 
tire event leading to 
lesson, tire lesson, and 
tire recommendations 

Describe tire situation 
leading to the Lesson 


Wlrat did yon learn 
from tins experience? 


✓ 


What do yon snggest to 
others to do in the 
futnre? 


Related standards or 
docnmen ts 


Search terms 













The LLIS process - Review Process 


oThe goal for review of a new lessons learned 
entry is to enhance the learning potential from the 
experience described in the entry. 

o The reviewers work with the submitter to 
provide feedback so the description of the 
situation is clear and ask technical questions so 
the write up is accurate. 

o The committee reviews the lesson so it has a 
meaning that can be understood even by those 
outside of NASA. 
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The LLIS process - Review Process 

o It is important to provide good situational context 
information to be able to understand how the 
lesson could be applied in the future. 

o The review team assists the lessons submitter in 
capturing pertinent details such as; 

• size and magnitude of the project 


• type of project 

• how the team discovered the situation 
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How Lessons Learned are Shared 

Kennedy Engineering Academy Forums are held 
to disseminate the results to a wide audience. 
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How Lessons Learned are Shared 


As the Space Shuttle Program was ending, lessons learned were recorded 
ideo format, using interviews to bring out more context and background 
nformation. In addition, visual and audio aids contribute to the learning 
r process. The videos are included as part of the lessons learned entry. 


in a 


1 1 Lessons Learned Entry: 4417 
1 Info: 




M Uina t Is »<a*«car, peers 

TM m Nearer 






TJii 

♦ « 

r 

i|fL 

1 

► 

i 

-V. 

* ^ 




« { l f . 




Lrom Lnna Emm 3*71 


racpiw ni-m-rr 


* • 


Lessons Learned tain : 5479 
Lesson Inis: 


ncswni-inaw 


.. Ill 


N p i i > l—fi ii »t SuS wc Cm.S 


D m riH iw et Pw— »» hw» 
h to tat IMP* arty l»Pt mmtmt n 


Lessons Lnrad Entry: 4018 


lwr^ok7iK»tmDl 


rfbtktli 
vt NASA »»i CMrMn| t a 
* SXASAmT 


Jkz 1 


’H*! l 
. 


a 


%t v* 







Lessons Use - Systems Engineering 


o As part of the entrance criteria for design reviews, projects 
query the lessons learned information system to determine 
which lessons might impact their project design. 

o A lessons learned search may spark additional questions to 
be researched or investigated 

o Past lessons learned submitters may be contacted or 
consulted on the new design. 

o The LLIS can serve as an expert locator or knowledge 
matching engine 
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Examples of Lessons Learned 


The design process for KSC subsystems in various 
stages of the design cycle were sampled for this 
paper. 

• For 8 of the systems, between 1 and 41 different search 
terms were used to search the LLIS (median of 9 
different search terms used) 

• These searches resulted in 4 to 270 "hits." 

• The team must review these search results and decide 
how to apply the information. 
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Examples of Lessons Learned 


o The following table shows how often the 
development teams have applied the 
recommendations they found by using the LLIS 


Project Name 

Search Results 
Returned 

Results 

Utilized 

% Results 
Utilized 

Mobile Launcher Cryogenic Systems 
Design LH 9 System 

18 

18 

100% 

Mobile Launcher Cryogenic Systems 
Design LO ? System 

52 

14 

27% 

Tail Service Mast Umbilical (TSMU), 
Mobile Launcher Element 

4 

4 

100% 

Offline Processing Integration High 
Pressure Gas Servicing 

270 

39 

14% 

Mobile Launcher, Breathing Air 
System 

90 

38 

42% 


17 


Vehicle Support Post (VSP ) team 


• The Vehicle Support Post (VSP ) team focused on 
gathering all relevant information for better 
planning and improving the design and 
implementation of the VSP subsystem while 
preventing or minimizing risks to the VSP project. 

• A search of the database returned Lessons 
Learned Entry 0588, Solid Rocket Booster (SRB) 
Holddown Post Incident. 

• The team used this lesson to improve 
shipping/handling pallets and containers to 
provide adequate restraint of the VSP. 
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Vehicle Support Post (VSP ) 


• This lesson concerned an expensive piece of 
ground support equipment hardware that slid off 
a forklift while it was being moved up a slight 
ramp at the Launch Equipment Test Facility 





Tail Service Mast Umbilical (TSMU) team 


o The lessons were evaluated by the design team 
for applicability. 




Project Name 

Search Results 
Returned 

Results 

Utilized 

% Results 
Utilized 

Tail Service Mast Umbilical (TSMU), 
Mobile Launcher Element 

4 

4 

100% 





Tail Service Mast Umbilical (TSMU) 
lesson actions are listed below 


o Focus on designing personnel access and safety 
limits. 

o Coordinate with the Hazardous Gas (HazGas) 
Subsystems project team to determine an 
efficient configuration of HazGas sensors to 
minimize risks. 

o Use a new release mechanism that eliminates 
the safety hazards associated with explosives, 
and provides a cost savings, by being reusable. 

o Use mechanical positioning mechanisms to 
perform the mating of the ground umbilical. 
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The Mobile Launcher Cryogenic L02 Systems 



The design team searched the LLIS and was able to apply 14 

relevant recommendations from the 52 items they reviewed, 

resulting in 27% utilization. 

A sample of recommendations from the lessons are listed below; 

• Minimize leakage by utilizing welded connections, pneumatic 
systems for controlling cryogenic valves, and purging system for 
valves flowing LH2 (from Lessons Learned Entry: 0034 T 

• Design/install a new leak detector sensor console to accommodate 
additional leak detectors (from Lessons Learned Entry: 01Q7 T 

• Design and install permanent safe access platforms (from Lessons 
Learned: 0112 T 

• Design a mechanism that will prevent the ET GH2 vent arm from 
rebounding back into an SRM (from Lessons Learned Entry: 0157 T 

• Perform outdoor wind tunnel testing of vent/relief valve to provide 
data, quantifying leak rates below which the hazard is eliminated 
(from Lessons Learned Entry 0184 T 
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Mobile Launcher Breathing Air System 



Project Name 

Search Results 
Returned 

Results 

Utilized 

% Results 
Utilized 

Mobile Launcher Cryogenic Systems 
Design L0 9 System 

52 

14 

27% 


Summary 



o Knowledge sharing is an everyday activity at the 
Kennedy Space Center through storytelling, 
Kennedy Engineering Academy presentations and 
through searching the Lessons Learned 
Information system. 

o Project teams search the lessons repository to 
ensure the best possible results are delivered. 

o The ideas from the past are not always directly 
applicable but usually spark new ideas and 
innovations. 
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Summary 



oTeams have a great responsibility to collect and 
disseminate these lessons so that they are shared 
with future generations of space systems designers. 

o Leaders should set a goal for themselves to host a 
set numbers of lesson learned events each year and 
do more to promote multiple methods of lessons 
learned activities. 

oHigh performing employees are expected to share 
their lessons, however formal knowledge sharing 
presentation are not the norm for many employees. 
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